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OBJECTIVE — Time-related biases in observational studies of drug effects have been described 
extensively in different therapeutic areas but less so in diabetes. Immortal time bias, time -window 
bias, and time-lag bias all tend to greatly exaggerate the benefits observed with a drug. 

RESEARCH DESIGN AND METHODS— These time-related biases are described and 
shown to be prominent in observational studies that have associated metformin with impressive 
reductions in the incidence of and mortality from cancer. As a consequence, metformin received 
much attention as a potential anticancer agent; these observational studies sparked the conduc- 
tion of randomized, controlled trials of metformin as cancer treatment. However, the spectacular 
effects reported in these studies are compatible with time-related biases. 

RESULTS — We found that 13 observational studies suffered from immortal time bias; 9 stud- 
ies had not considered time -window bias, whereas other studies did not consider inherent time- 
lagging issues when comparing the first-line treatment metformin with second- or third-line 
treatments. These studies, subject to time-related biases that are avoidable with proper study 
design and data analysis, led to illusory extraordinarily significant effects, with reductions in 
cancer risk with metformin ranging from 20 to 94%. Three studies that avoided these biases 
reported no effect of metformin use on cancer incidence. 

CONCLUSIONS — Although observational studies are important to better understand the 
effects of drugs, their proper design and analysis is essential to avoid major time-related 
biases. With respect to metformin, the scientific evidence of its potential beneficial effects 
on cancer would need to be reassessed critically before embarking on further long and ex- 
pensive trials. 



Time-related biases are common in 
observational studies of drug effects 
and have been described extensively 
in several therapeutic areas. However, these 
biases have not been described in detail in 
the field of diabetes. Time-related biases 
include immortal time bias, a bias intro- 
duced with time-fixed cohort analyses that 
misclassify unexposed time as exposed; 
time-window bias, a bias introduced be- 
cause of differential exposure opportunity 
time windows between subjects; and time- 
lag bias, a bias introduced by comparing 
treatments given at different stages of the 
disease (1,2). These biases are known to 
exaggerate downward the effect of a 
drug, thus making a drug seem to be pro- 
tective when in fact it may have no effect. 
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In this review, we show that several of the 
observational studies investigating the as- 
sociation between metformin and cancer 
incidence and mortality are affected by 
these time-related biases. 

Metformin is a drug of choice for the 
management of type 2 diabetes mellitus 
(3,4). It reduces insulin resistance, improves 
glycemic control, and can be combined 
safely with other antidiabetic drugs (5). In 
2005, an observational study using data 
from Tayside, Scotland, reported a signifi- 
cant 23% reduction in the incidence of any 
cancer with metformin use, thus putting for- 
ward the hypothesis that metformin could 
lower the risk of cancer onset in patients 
with diabetes (6). This study generated great 
interest in metformin as an agent in the 



prevention and treatment of cancer, and 
many preclinical studies showed that met- 
formin can inhibit the growth of cancer cells 
in vitro and in vivo (7,8). 

In parallel, a series of observational 
studies conducted in various databases 
generally reported similar beneficial results 
with metformin, thus "confirming" the 
findings of the 2005 study. Two meta- 
analyses including some of these observa- 
tional studies reported a highly significant 
reduction in cancer incidence or mortality 
associated with metformin use (risk reduc- 
tions ranged between 31 and 34%) (9,10). 
This convergence of evidence from multi- 
ple preclinical and epidemiological studies 
formed the impetus to recommend the 
conduct of randomized, controlled trials 
(RCTs) of metformin in the prevention 
and treatment of cancer (11-14). However, 
as discussed later, several of these observa- 
tional studies had important time-related 
biases that likely exaggerated the potential 
antitumor effects of metformin. 

STUDIES OF CANCER 
PREVENTION— The majority of 
studies published to date have reported 
the role of metformin in preventing the 
occurrence of cancer in general and of 
some cancers in particular. To describe 
the different variations of this bias, we use 
only some of these studies as a model; the 
list of studies that incurred the same 
biases is provided in Table 1 (15-37). 

Immortal time bias 

The first published epidemiological study 
to verify this hypothesis involved a co- 
hort of patients of 10,309 new users of 
oral hypoglycemic agents (OHAs) identi- 
fied from the Saskatchewan Health data- 
bases (15). Patients entered the cohort at 
the time of their first OHA prescription 
during 1991-1996. They were followed 
through 1999 for death due to cancer, 
which occurred in 407 patients. Expo- 
sure was classified as sulfonylureas only 
or metformin, with the latter including 
users of only metformin and those who 
also used sulfonylureas at some point in 
time during follow-up. A Cox propor- 
tional hazards model was used to esti- 
mate the hazard ratio (HR), adjusted for 
age, sex, insulin use, and a chronic dis- 
ease score. The adjusted HR of cancer 
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Table 1 — Time-related biases in observational studies investigating the effects of 
metformin on cancer incidence and as a cancer treatment 



Bias (author [reference]) 


Study design 


Outcome 


Relative risk a (95% CI) 


Immortal time bias 


Bowker et al. (15) 


Cohort 


Cancer mortality 


0.8 (0.6-0.9) 


Bowker et al. (16) 


Cohort 


Cancer mortality 


0.80 (0.65-0.98) 










Lee et al. (18) 


Cohort 


Any cancer 


0.12 (0.08-0.19) 




Cohort 


Colorectal cancer 


0.36 (0.13-0.98) 




Cohort 


Liver cancer 


0.06 (0.02-0.16) 


Buchs et al. (19) 


Cohort 


Any cancer 


0.996 (0.994-0.998) c 


Chen et al. (20) 


Cohort 


Liver cancer 


0.24 (0.07-0.80) 


Geraldine et al. (21) 


Cohort 


Any cancer 


0.20 (0.03-1.64) 


Yang et al. (22) 


Cohort 


Any cancer 


0.51 (0.31-0.82) d 




Cohort 


Any cancer 


0.30 (0.13-0.70) 6 




Cohort 


Lung cancer 


0.55 (0.32-0.94) 




Cohort 


Liver cancer 


0.49 (0.37-0.66) 


He et al. (24) 


Cohort 


Prostate: all-cause 


0.55 (0.32-0.96) 


Lee et al. (25) 


Cohort 


Colorectal: all-cause 
mortality 


0.66 (0.45-0.98) 




Cohort 


Colorectal: cancer 
mortality 


0.66 (0.48-0.92) 


He et al. (26) 


Cohort 


Breast: all-cause mortality 


0.52 (0.28-0.97) 




Cohort 


Breast: cancer mortality 


0.47 (0.24-0.90) 


Romero et al. (27) 


Cohort 


Ovary: progression 


0.38 (0.16-0.90) 




Cohort 


Ovary: all-cause 


0.43 (0.16-1.19) 


Time -window bias 


Monami et al. (28) 


Nested case- 
control 


Any cancer 


0.28 (0.13-0.57) f 


Wright et al. (29) 


Case-control 


Prostate cancer 


0.56 (0.32-1.00) 


Hassan et al. (31) 


Case-control 


Liver cancer 


0.3 (0.2-0.6) 


Bodmer et al. (32) 


Nested case- 
control 


Breast cancer 


0.44 (0.24-0.82) g 


Bosco et al. (33) 


Nested case- 
control 


Breast cancer 


0.81 (0.63-0.96) 


Bodmer et al. (34) 


Nested case- 
control 


Ovarian cancer 


0.61 (0.30-1.25) 


Bodmer et al. (35) 


Nested case- 
control 


Pancreatic cancer 


0.43 (0.23-0.80) h 


Bodmer et al. (36) 


Nested case- 


Colorectal cancer 


1.43 (1.08-1.90) 1 


Time-lag bias 




Cohort 


Any cancer 


1.1 (1.0-1.2? 




Cohort 


Any cancer 


1.4(1. 3-1. 6) k 


Libby et al. (37) 


Cohort 


Any cancer 


0.63 (0.53-0.75) 



a Relative risk is used as a generic term for rate ratio, hazard ratio, and odds ratio. b Among patients treated with 
insulin. c Relative risk based on every additional metformin prescription purchased. d Among patients 
with HDL cholesterol levels >1.0 mmol/L. e Among patients with HDL cholesterol levels <1.0 mmol/L. 
f Among patients exposed for at least 36 months. g Among patients who received >40 metformin pre- 
scriptions. h Among female patients who received >30 metformin prescriptions. 'Among patients who re- 
ceived >50 metformin prescriptions. ^Sulfonylurea-metformin combination vs. metformin monotherapy. 
k Insulin vs. metformin monotherapy. 



mortality for sulfonylurea versus metfor- metformin relative to sulfonylurea as 0.8 
min was 1.3 (95% CI 1.1-1.6), which, (0.6-0.9), suggesting a protective effect of 
when reversed, gives the HR for metformin. 



Immortal time bias is introduced in 
this study from its definition of exposure 
and related analysis. The 3,340 subjects 
who entered the cohort while using sul- 
fonylureas and remained on these 
throughout the entire follow-up and the 
1 ,229 who used only metformin from day 
1 throughout follow-up pose no problem 
to the definition of exposure. The bias is 
introduced by classifying some of the 
remaining 5,740 who used sulfonylureas 
and metformin at various times during 
follow-up as "metformin users." Although 
those whose cohort entry prescription 
was metformin are classified correctly in 
the metformin-exposed group, those 
whose cohort entry prescription was a 
sulfonylurea are not (Fig. 1). Indeed, the 
time between the sulfonylurea prescrip- 
tion at entry into the cohort and the first 
metformin prescription during follow-up 
is called "immortal" (thick gray line in Fig. 
1) because the patient must be alive to 
have received their first metformin pre- 
scription (1). Moreover, this immor- 
tal person-time should be classified as 
sulfonylurea-exposed until the start of 
metformin, at which point the remaining 
person-time can be classified as metfor- 
min-exposed. In this study, the authors 
misclassified this immortal person-time 
as metformin-exposed, which will lead 
to immortal time bias. 

Because the data necessary to assess 
the magnitude of the bias are not pro- 
vided in the article, for the sake of 
illustration we assume that the mean 
delay between cohort entry and the first 
metformin prescription was 1 year among 
the 5,740 combined users. This would 
result in 5,740 immortal person-years of 
sulfonylurea exposure misclassified as 
metformin exposure. The reported rates 
of cancer death for metformin (245/ 
39,026 = 6.3 per 1,000 person-years) 
and for sulfonylureas (162/16,700 = 9.7 
per 1,000 person-years), which were 
based on misclassified denominators, 
produced a crude rate ratio of 0.65. By 
properly reclassifying exposure (per our 
assumption), the rates would become 
245/(39,026-5,740) = 7.4 per 1,000 
person-years for metformin and 162/ 
(16,700+5,740) = 7.2 per 1,000 person- 
years for sulfonylureas, resulting in a cor- 
rected crude rate ratio of 1.0. There are 
more sophisticated ways to estimate the 
rate ratio while properly accounting for 
such time-varying exposures, such as Cox 
proportional hazards models with time- 
dependent factors. An alternative ap- 
proach simply is to use an intent-to-treat 
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Immortal time and misclassified 



Metformin 
users 



Sulfonylurea 
users 



-A 



-4 0- 



Time zero: 
First prescription 



• = Cancer death 
0 = Sulfo Rx 

♦ = Metformin Rx 

Figure 1 — Illustration of immortal time bias using a description of patients exposed to metformin 
and sulfonylureas who died of cancer according to the definition used in the cohort study by 
Bowker et al. (15). The top patient initiated and continued treatment with a sulfonylurea and 
subsequently switched to or added metformin but is classified as a metformin user during the 
entire follow-up. The time between entry into the cohort and the first metformin prescription thus 
is immortal (thick line) because the subject must survive to receive this first metformin pre- 
scription and is misclassified as exposed to metformin when in fact it is exposed to sulfonylurea, 
leading to immortal time bias. 



approach (as is done in RCTs) that classi- 
fies exposure according to the first OHA 
prescription type, irrespective of switch- 
ing to or adding the other agent, with, 
of course, the limitations of interpretation 
inherent to this approach. 

In a subsequent publication reanalyz- 
ing the same data, the authors recog- 
nized the presence of immortal time bias, 
claiming "we extended our analyses by 
classifying time-varying exposure of met- 
formin, sulfonylureas and insulin 
therapy" (16). The reported an adjusted 
HR of 0.80 (95% CI 0.65-0.98; P = 0.03) 
for metformin use relative to sulfonylurea 
monotherapy and the corresponding 
rates of cancer mortality (6.3 vs. 9.7 per 
1 ,000 person-years) remained identical to 
those reported previously, which were 
subject to immortal time bias. This perfect 
equality of rates is numerically impossible 
and thus casts doubt on whether the time- 
varying statistical model was applied cor- 
rectly to metformin exposure to properly 
reclassify the misclassified exposure in 
this second publication. 

Immortal time bias also was evident 
in a study using Taiwanese National 
Health Insurance data in 2000 (18). It in- 
cluded 12,005 patients with type 2 



diabetes who received at least two pre- 
scriptions of metformin during 2000- 
2007; these patients were compared 
with 4,597 patients who did not use met- 
formin but had other OHAs and 8,643 
who did not use any OHA during this 
period. Cancer events occurring 1 year 
after entry into the cohort until the end 
of 2007 were identified. Using the Cox 
proportional hazards model to adjust for 
covariates, the use of metformin was as- 
sociated with lower incidence of cancer 
with HRs of any cancer of 0.12 (95% CI 
0.08-0.19), of colorectal cancer (0.36 
[0.13-0.98]), liver cancer (0.06 [0.02- 
0.16]), and pancreatic cancer (0.15 
[0.03-0.79]). 

Immortal time bias is introduced in 
this study from the definition of metfor- 
min exposure. Indeed, the 12,005 sub- 
jects defined as exposed to metformin 
during 2000-2007 had to have at least 
two prescriptions for metformin during 
this period. The bias is introduced be- 
cause the time between the first and sec- 
ond metformin prescriptions during 
follow-up is immortal, that is, the patient 
must be cancer-free to have received the 
second metformin prescription, which 
could have been dispensed much later. 



Moreover, this person-time should be 
classified as unexposed until the second 
metformin prescription, at which point 
the remaining person-time should be 
classified as metformin-exposed. Thus, 
the analysis misclassified all this person- 
time as metformin exposure, which led to 
immortal time bias. In contrast, the com- 
parison group of patients who did not use 
any OHA did not have such a condition 
of a second prescription. 

Another example of this bias is the 
study using the Hong Kong Diabetes 
Registry to form a cohort of 2,658 patients 
diagnosed with type 2 diabetes who did 
not use metformin when enrolled in the 
study between 1996 and 2005 or in the 
2.5 years before enrollment, with follow- 
up until 2005 (22). During a median 5.5 
years of follow-up, 129 patients devel- 
oped cancer. A Cox proportional hazards 
model was used to estimate the HR of 
cancer, which was adjusted for several 
covariates. The use of metformin during 
follow-up was associated with signifi- 
cant reductions in cancer incidence, 
with HRs of 0.51 (95% CI 0.31-0.82) 
among patients with HDL cholesterol 
>1.0 mmol/L and 0.30 (0.13-0.70) 
among patients with HDL cholesterol 
<1.0 mmol/L. 

Immortal time bias also is present in 
this study because none of the patients 
were using metformin at the time of entry 
into the cohort or during the 2.5 years 
before but were classified in the analysis 
as metformin users if they received a pre- 
scription for metformin during the follow- 
up . The bias then is introduced by classifying 
the time between entry into the cohort 
and the first metformin prescription as 
metformin-exposed. This person- time is 
immortal and should have been classified 
as unexposed until the start of metformin, 
at which point the remaining person- 
time should be classified as metformin- 
exposed. Misclassifying all this person-time 
as metformin-exposed leads to immortal 
time bias. 

This bias also is present in a recent 
study investigating the association be- 
tween metformin and the incidence of 
lung cancer (23). In that study, the au- 
thors used administrative databases from 
the Taiwanese National Health Insurance 
program to extract a cohort of 19,624 pa- 
tients who were treated with antidiabetic 
agents between 2000 and 2005. In Cox 
proportional hazards models, the use of 
metformin was associated with a 45% risk 
reduction of lung cancer (HR 0.55 [95% 
CI 0.37-0.82]). Similar results were 
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observed for thiazolidinediones and 
a-glucosidase inhibitors (0.55 [0.32- 
0.94] and 0.61 [0.38-0.98], respectively), 
whereas null results were observed for in- 
sulin and sulfonylureas (1.00 [0.68-1.45] 
and 1.27 [0.75-2.15], respectively). As 
with the studies described earlier, immor- 
tal time bias was introduced by misclassi- 
fying unexposed person-time as exposed 
person-time. Overall, the 19,624 pa- 
tients generated 108,213 person-years 
of follow-up. Based on the data presented 
in the study, the 16,616 patients who 
ever used metformin generated 93,987 
person-years of exposure, an average of 
5.7 years per patient. However, the latter 
included immortal person- time (i.e., time 
between entry into the cohort and the 
first metformin prescription, during 
which no event could have occurred). As- 
suming an average 1-year delay between 
entry into the cohort and the first met- 
formin prescription, a total of 16,616 im- 
mortal person-years would have been 
misclassified as exposed. As shown in 
Table 2, by correctly reclassifying this 
person-time, the rate of the unexposed 
group would become 33/(14,266 + 
16,616) = 10.7 per 10,000 person-years 
instead of 23.2 per 10,000 person-years, 
whereas the rate in the metformin- 
exposed group would become 96/(93,987 
- 16,616) = 12.4 per 10,000 person-years 
instead of 10.2 per 10,000 person-years, 
resulting in a corrected crude rate ratio of 
1.16. Based on similar calculations, a delay 
of only 9.6 months between entry into the 
cohort and the first metformin prescription 
would have been necessary to bring the 
crude rate ratio to the null value. Thus, it 



is important to recognize that in the context 
of a highly prevalent exposure such as met- 
formin, even small misclassifications of 
just a few months can result in greatly bi- 
ased rate ratios. 

As summarized in Table 1 , immortal 
time bias affected nine observational 
studies evaluating the association be- 
tween metformin and cancer incidence 
or mortality. Because of important mis- 
classifications of exposure, the risk re- 
ductions observed in these studies 
were greatly exaggerated in favor of met- 
formin. Furthermore, the variations in 
the reported risk reductions, ranging be- 
tween 20 and 94% (Table 1), are a direct 
reflection of the different magnitude of 
misclassification of immortal time in 
the studies, leading to bias of different 
magnitudes. 

Time-window bias 

A study design that has been used exten- 
sively is the nested case-control analysis 
conducted, in this first study, within a 
cohort of 22,621 women newly treated 
with OHAs between 1994 and 2005 who 
were identified using the U.K. General 
Practice Research Database (32). During 
follow-up, 309 women developed breast 
cancer and were matched to 1,153 con- 
trols selected from the cohort on age, gen- 
eral practice, and index date. Overall, the 
use of metformin was not associated 
with a decreased risk of breast cancer 
(odds ratio [OR] 1.03 [95% CI 0.76- 
1.39]). However, for patients who were 
prescribed at least 40 prescriptions, met- 
formin was associated with a significant 
risk reduction (0.44 [0.24-0.82]). 



In this study, the authors used risk- 
set sampling, making metformin expo- 
sure time-dependent and thus avoiding 
immortal time bias. However, the cases 
and controls were not matched on dura- 
tion of follow-up or, more specifically, on 
duration of exposure opportunity time, 
which can lead to time -window bias (2). 
Matching on duration of follow-up en- 
sures the same opportunity time of being 
exposed for cases and matched controls. 
In this study, the null finding for overall 
use of metformin likely indicates that 
cases and matched controls had, on aver- 
age, similar follow-up times. However, it 
is possible that in certain subgroups, such 
as in those who received at least 40 pre- 
scriptions, the follow-up may have been 
different between cases and controls. As 
such, it is possible that controls had a lon- 
ger follow-up period than cases and 
hence a greater opportunity to receive ad- 
ditional prescriptions. The opposite 
could have occurred as well, and there- 
fore the direction of this bias highly de- 
pends on the distribution of follow-up 
among the randomly selected controls. 
Indeed, in a subsequent study using 
similar methods to investigate the effects 
of metformin on the incidence of colo- 
rectal cancer, the same authors reported 
an increased risk among patients who 
received at least 50 prescriptions (OR 
1.43 [95% CI 1.08-1.90]) (36). This 
time-window bias also likely was pres- 
ent in other studies by the same authors 
who used this same approach to inves- 
tigate the effect of metformin use on 
the risk of ovarian and pancreatic can- 
cers (34,35). 



Table 2 — Comparison between biased time-fixed and corrected time-dependent data analyses for the cohort study of metformin and 
lung cancer incidence (23) 







Metformin users 




Nonusers 








Lung cancer 
cases (n) 


Person- Rate per 10,000 
years (n) person-years 


Lung cancer 
cases (n) 


Person- 
years (n) 


Rate per 10,000 
person-years 


Crude rate ratio 
(95% CI) 


Biased time-fixed analysis 


Immortal and unexposed 


At risk person-time 


96 


77,371 


33 


14,266 








Corrected time- 
dependent analysis 


Immortal and unexposed 
person-time 


0 


0 


0 


16,616 






At risk person-time 


96 


77,371 


33 


14,266 






Total 


96 


77,371 12.4 


33 


30,882 


10.7 


1.16 (0.78-1.72) 



The boldface values represent the immortal and unexposed person-time misclassified as exposed in the biased analysis and properly classified as unexposed in the 
corrected time-dependent analysis. 
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Another example of time-window 
bias is a study investigating the associa- 
tion between antidiabetic drugs and the 
risk of hepatocellular carcinoma (31). 
This was a single-center, hospital-based, 
case-control study from Texas, involving 
420 cases of hepatocellular carcinoma 
and 1,104 hospital controls identified 
between 2000 and 2008. The use of met- 
formin and thiazolidinediones was 
associated with a decreased risk of hepa- 
tocellular carcinoma (OR 0.3 [95% CI 
0.2-0.6] and 0.3 [0.1-0.7], respectively). 
It is interesting that cases were more likely 
than controls to be controlled with diet 
(13.1 vs. 2.3%, respectively). A priori, 
diet-controlled diabetes would have 
been expected to be associated with the 
lowest risk of cancer because it is used 
early in the natural history of the disease 
primarily in patients with a new diag- 
nosed of type 2 diabetes (based on the 
assumption that disease severity is associ- 
ated with an increased risk of cancer). 
However, it is surprising that diet- 
controlled diabetes was associated 
strongly with an increased risk of hepato- 
cellular carcinoma (7.8 [1.5-40.0]). 
Whereas duration of diabetes was gener- 
ally similar between the cases and con- 
trols, this finding reveals that duration 
of treated diabetes was largely differential 
between cases and controls. Indeed, the 
much lower prevalence of diet-controlled 
diabetes among the controls suggests that 
these patients had a longer treatment his- 
tory than the cases. As such, on the basis 
of their longer treatment history, controls 
had a greater opportunity to use metfor- 
min and other antidiabetic drugs. This 
differential treatment time window be- 
tween cases and controls likely led to 
the apparent increased risk of hepatocel- 
lular carcinoma with diet-controlled dia- 
betes and consequently to an apparent 
decreased risk with metformin and thia- 
zolidinediones. 

As discussed earlier and summarized 
in Table 1 , time-window bias can lead to 
spurious associations even when proper 
time-dependent analyses are performed. 
In some studies, there was an attempt to 
either adjust or match on duration of di- 
abetes (28,31). Although controlling for 
this important variable certainly minimi- 
zes confounding by disease severity, it 
does not correct for the differential 
lengths of the treatment time windows 
in the cases and controls. Furthermore, 
it is difficult to predict the direction of 
the time-window bias because it depends 
on the distribution of treatment duration 



in the randomly selected controls com- 
pared with the cases. It is fortunate that 
this bias can easily be avoided at the de- 
sign stage by properly accounting for du- 
ration of treatment in the cases and 
controls (2). 

Bias from time lag and latency 

Some studies that have used cohorts of 
patients treated with antidiabetic drugs 
have compared the exposure time of 
metformin use with exposure time of 
other antidiabetic treatments, including 
sulfonylureas and insulin. Several meth- 
odological aspects have to be considered 
when a first-line therapy such as metfor- 
min is compared with second- or third- 
line therapies (Fig. 2). First, patients are 
unlikely to be at the same stage of 



diabetes, which can induce confounding 
by disease duration: longer duration of 
diabetes may be associated with higher 
cancer incidence, independent of age. In 
such a case, the proper comparison would 
require matching on disease duration so 
that the cohort would be formed as in Fig. 
2 (bottom) rather than the time-lagged 
comparison suggested by Fig. 2 (top). Sec- 
ond, if the first treatment used is associated 
with an increased incidence of cancer, al- 
beit after a long period of exposure, it is 
likely that the cancer will occur during ex- 
posure to the second-line agent, in which 
case attribution of the cancer to either treat- 
ment is challenging — thus the importance 
of considering latency time windows. 

A study that was affected by con- 
founding by disease stage is one that used 
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Figure 2 — Depiction of a time-lagging bias when comparing a first-line diabetic drug (metfor- 
min) used at an earlier stage of diabetes with second- or third-line drugs used or added at a later 
stage (sulfonylurea) (top) and a cohort design that controls for time-lagging bias by comparing 
two patients at the same stage of diabetes (bottom). The arrows represent the time point where 
cohort follow-up starts in conducting comparisons: top represents a time-lagged comparison, 
whereas bottom arrow represents a comparison that accounts for stage of diabetes. (A high- 
quality color representation of this figure is available in the online issue.) 



care, diabetesj ournals . org 



Diabetes Care, volume 35, December 2012 



2669 



Metformin and cancer: time biases 



The Health Information Network, a U.K. 
general practice database (17). In this 
study, the authors identified 62,809 users 
of OHAs or insulin between 2000 and 
2007. The study population was then 
subdivided into four cohorts: cohort 1 in- 
cluded new users of metformin mono- 
therapy; cohort 2 comprised new users 
of sulfonylurea monotherapy; cohort 3 
included those who switched from mono- 
therapy with metformin or sulfonylurea 
to a combination of both drugs; and co- 
hort 4 included those who switched from 
OHAs to insulin. Incidence rates of cancer 
(specifically breast, pancreas, colorectal, 
and prostate cancers) were calculated 
within each of the aforementioned co- 
horts, and Cox proportional hazards 
models were used to compare cohorts 2, 
3, and 4 with cohort 1 (metformin mono- 
therapy). After a mean follow-up of 2 
years, the HRs (95% CIs) were 1.4 (1.2- 
1.5) for sulfonylurea monotherapy, 1.1 
(1.0-1.2) for the metformin-sulfonylurea 
combination, and 1.4 (1.3-1.6) for insu- 
lin. Among patients treated with insulin, 
the concomitant use of metformin was as- 
sociated with a statistically significant risk 
reduction (0.54 [0.43-0.66]). However, 
this strong inverse association was likely 
due to immortal time bias because expo- 
sure to metformin was assessed at any 
time during follow-up and thus included 
person-time during which patients were 
not yet exposed to this therapy (Table 1). 
Furthermore, as noted by others, the sur- 
vival curves of the different cohorts pre- 
sented by the authors diverged as early as 
during the first year of treatment, thus 
arguing against a causal effect, which is 
biologically inconsistent with the long la- 
tencies of cancers (38). Aside from reverse 
causality and confounding, which are cer- 
tainly important considerations, such 
early divergence in the survival curves 
can also be explained by two other fac- 
tors. First, comparing the different co- 
horts, which consisted of second- and 
third-line treatments, with metformin 
monotherapy, a first-line treatment, in- 
herently introduces biases related to dis- 
ease duration and progression that may 
not be dealt with adequately during anal- 
ysis. Second, the consideration of cancers 
diagnosed early after entry into the cohort 
is problematic, especially for patients 
with a history of OHA use (i.e., cohorts 
3 and 4), because it ignores the fact that 
previous exposure might have affected fu- 
ture cancer risk. Indeed, patients may re- 
main at risk for an extended period of 
time long after discontinuation of 



treatment. For example, former smokers 
with a history of smoking one pack per 
day for a period of 1 year have a nearly 
threefold increased risk of lung cancer af- 
ter 30 years of cessation (39). One ap- 
proach to minimize this bias is to apply 
time-lag periods to exclude cancers diag- 
nosed within a specified time period after 
entry into the cohort. This method works 
reasonably well, especially if there is clus- 
tering of cancers early during the treat- 
ment, as was observed in this study (17). 

A study that introduced a variation of 
bias due to time-lagging of comparison 
cohorts was that based on the Diabetes 
Audit and Research in Tayside Study 
cohort of patients diagnosed with type 2 
diabetes in Tayside, Scotland (37). All 
4,085 eligible new users of metformin be- 
tween 1994 and 2003 were matched in- 
dividually with 4,085 nonusers on year of 
diabetes diagnosis; each pair was assigned 
the date of entry into the cohort as the 
date of the first metformin prescription 
of the user. Of the subjects who were can- 
cer free at cohort entry, 771 developed 
cancer during follow-up. Cancer was di- 
agnosed in 7.3% of the metformin users 
compared with 11.6% of nonusers. A 
Cox proportional hazards model was 
used to estimate the HR of cancer, ad- 
justed for several covariates. The adjusted 
HR of cancer associated with metformin 
use was 0.63 (95% CI 0.53-0.75), 
suggesting a strong protective effect of 
metformin. 

Although this study avoided biases 
associated with prevalent exposures by 
using a new-user cohort of patients treated 
with metformin, this approach was not 
used for the comparison group, which 
was not based on a specific comparison 
drug. Because the comparison metformin 
nonuser does not have a prescription date 
to define time zero, it was assigned the 
date of the first metformin prescription of 
its matched user, a date called the index 
date. In choosing among potential non- 
users for a given user, a variation of bias 
from time lags was introduced. Indeed, if 
the potential matched nonuser had a di- 
agnosis of cancer or had died prior to the 
index date, it was discarded. However, it 
"was potentially available for a different 
metformin user. . .this process was re- 
peated until suitable comparators were 
identified." 

Nonusers should be alive and cancer 
free at entry into the cohort just like the 
matched users, but the net effect of 
selecting the nonusers with replacement 
is twofold. First, the final nonuser group 



had zero subjects excluded because of 
cancer before the index date, in contrast 
with the 239 excluded from the metfor- 
min group. Second, the nonusers who 
should have been excluded (and not 
reused) because of a previous cancer 
were included as nonusers matched to 
other users. As a result, cancers that 
should have been an exclusion criterion 
were transferred to the follow-up period 
after the index date and counted as out- 
come events, thus artificially increasing 
the rate of cancer in the nonuser group. 
This phenomenon is noticeable in the 
Kaplan-Meier curves that suggest a clus- 
tering of cancers in the first 2 years of 
follow-up of the nonuser group. Thus, by 
forming the nonuser group, the authors 
artificially induced a cohort that was 
immortal and cancer free before the index 
date but had more deaths and cancers 
after entry into the cohort. As a result of 
this transfer, the nonuser group had 474 
cancers diagnosed during follow-up com- 
pared with 297 in the metformin group. If 
the exclusion of 239 cancers before the 
first metformin prescription is applied to 
the nonuser group, the 474 would be 
reduced to 177. 

STUDIES OF CANCER 
TREATMENT— A number of studies 
investigated the effects of metformin 
among patients with cancer. Several of 
these studies reported significant risk 
reductions for all-cause mortality, cancer- 
specific mortality, and cancer progression, 
ranging between 34 and 62% (24-27). 
All of the studies reporting these impor- 
tant risk reductions suffered from im- 
mortal time bias (summarized in Table 
1). We describe below selected studies to 
illustrate this bias in the setting of cancer 
treatment. 

In the first study, the authors re- 
viewed the records of 233 patients di- 
agnosed with prostate cancer between 
1999 and 2008 at a medical institution 
in Texas (24). They evaluated whether an- 
tidiabetic treatments were associated with 
all-cause mortality in this patient popula- 
tion. Cox proportional hazards models 
were constructed, with ever-use of insu- 
lins and OHAs entered as independent 
variables, and adjusted for potential con- 
founders. Their results indicate that met- 
formin (HR 0.55 [95% CI 0.32-0.96]) 
and thiazolidinediones (0.45 [0.21- 
0.97]) were associated with a significant 
decrease in all-cause mortality. No statis- 
tically significant associations were ob- 
served with the other antidiabetic 
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agents, although few patients were ex- 
posed in this small dataset. Misclassifying 
as exposed the time between cohort entry 
and first prescription of metformin or a 
thiazolidinedione introduced immortal 
time bias, thus greatly exaggerating the 
benefits of these drugs on all-cause mor- 
tality. That exposure was defined as any 
time during the 10-year follow-up period 
contributed to compound the effect of 
this misclassification. As explained ear- 
lier, the appropriate analysis would have 
treated exposures to the different antidia- 
betic agents as time-dependent variables. 

The authors of another study identi- 
fied 595 patients who had been diagnosed 
with both colorectal cancer and diabetes 
mellitus and compared the 258 taking 
metformin any time during follow-up 
with the 337 nonusers (25). After a me- 
dian follow-up of 41 months, the ad- 
justed HR of all-cause mortality with 
metformin use was 0.66 (95% CI 0.45- 
0.98), whereas for colorectal cancer, mor- 
tality was also 0.66 (0.48-0.92). Here 
again, these mortality reductions are the 
result of immortal time bias caused by 
misclassifying as exposed to metformin 
the time between cohort entry and first 
prescription, when in fact it is unexposed. 

Immortal time bias also was present 
in a cohort study of 1,983 consecutive 
patients with HER2+ breast cancer treated 
between 1 January 1998 and 30 Septem- 
ber 2010 (26). All-cause and cancer- 
specific deaths were identified. Among 
the patients with diabetes, the HR of all- 
cause death associated with metformin 
was 0.52 (95% CI 0.28-0.97), whereas 
for breast cancer-specific mortality it 
was 0.47 (0.24-0.90). These mortality re- 
ductions again are the result of immortal 
time bias caused by misclassifying as ex- 
posed the time between cancer diagnosis 
and first prescription of metformin given 
during follow-up, when in fact it is unex- 
posed to metformin. 

CONCLUSIONS— We have shown 
that a large number of observational studies 
reporting significant reductions in the in- 
cidence of or mortality from cancer associ- 
ated with metformin use are afflicted with 
time-related biases such as immortal time 
bias, time-window bias, and time-lag bias. 
By not classifying metformin exposure 
during follow-up or measuring metformin 
exposure over different time intervals prop- 
erly, the resulting analyses produced ap- 
parent reductions in risk that were created 
artificially by the misclassification of met- 
formin exposure. These biases, regrettably 



common in pharmacoepidemiology, have 
been described extensively in different ther- 
apeutic areas (1,2,40-42) but do not seem 
to have sufficiently penetrated the fields of 
diabetes and cancer. Although two of the 
studies recognized the possibility of im- 
mortal time bias, the technique of data 
analysis required to address it was clearly 
not appropriate (16,18). 

Other studies have been conducted 
with varying results; some have found no 
association between metformin use and 
cancer incidence or prognosis (43-48), 
others have found lower rates of cancer 
with metformin (49-57), and one study 
found an increased risk (58). Although 
these studies were designed and analyzed 
with no obvious time-related biases, it is 
of course possible that other epidemio- 
logical biases such as selection, informa- 
tion, or confounding could have affected 
them. This article focused specifically on 
time-related biases, where metformin was 
associated with strong risk reductions, 
ranging from relative risks of 0.80 (20% 
risk reduction) to 0.06 (94% risk reduc- 
tion), likely due to flaws in their designs 
and methods of analysis. 

Three recent studies that specifically 
used the time-dependent techniques 
needed to avoid both immortal time and 
time-window biases found no association 
between metformin use and cancer in- 
cidence (59-61). The first study used the 
U.K. General Practice Research Database 
and found a rate ratio of prostate cancer 
incidence of 1.23 (95% CI 0.99-1.52) 
with metformin use. With more than 36 
prescriptions the rate ratio was signifi- 
cantly elevated at 1.40 (1.03-1.89). The 
second study used the Kaiser Permanente 
database and found no effect of metfor- 
min on the incidence of the 10 different 
cancers studied, with HRs ranging be- 
tween 0.8 (0.6-1.1) for melanoma to 1.3 
(1 .0-1 .6) for kidney/renal and pelvic can- 
cers. Finally, no effect of metformin was 
found on lung cancer incidence (61). 

It is also important to recognize that 
most observational studies focused on the 
incidence of cancer as it relates to the 
effects of metformin on carcinogenesis, 
which is distinct from its effects on pro- 
liferation of established tumors. Never- 
theless, large RCTs using patients with 
established tumors currently are being 
planned or already are in progress. One 
such study is the MA. 32 being conducted 
by the National Cancer Institute of 
Canada, a multicenter phase III RCT 
that includes almost 3,600 women with 
early breast cancer and is comparing 



metformin to placebo as adjuvant therapy 
on the primary end point of invasive, 
disease-free survival over a 5 -year follow- 
up (12,13). The authors claim that "we be- 
lieve the science underlying such a trial is 
strong, the novelty of the intervention is 
high, and the potential for benefit is large" 
(12). Although it is possible that the in 
vitro science is strong and metformin 
may lead to positive results, we have 
shown that the pharmacoepidemiological 
evidence from observational studies is 
weak at best. 

In conclusion, time-related biases are 
common in the field of diabetes and can 
be avoided using appropriate study de- 
signs and methods of analysis. In the case 
of the association between metformin and 
cancer, we believe that methodologically 
inaccurate studies, even if their results are 
replicated in different settings, should not 
be the driving force behind long and 
expensive trials. At this time, it may be 
important to question and reassess the 
scientific evidence of the potential bene- 
ficial effects of metformin on cancer. 
Although the in vitro science seems to 
be strong, certainly all observational stud- 
ies identified as potentially biased would 
need to be redone properly to correct for 
the bias. Moreover, new observational 
studies using more rigorous designs and 
analyses that avoid these biases should 
urgently be undertaken before more ran- 
domized trials are initiated in vain. 
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